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ABSTRACT 

Objectives: To improve clinical study developments 
for elderly populations, we aim to understand how they 
transfer their experiences into validated, standardised 
self-completed study measurement instruments. We 
analysed how women (mean 78±8 years of age) 
participating in a randomised controlled trial (RCT) 
cognised study instruments used to evaluate outcomes 
of the intervention. 

Setting: The interview study was nested in an RCT on 
chronic neck pain using common measurement 
instruments situated in an elderly community in Berlin, 
Germany, which comprised of units for independent 
and assisted-living options. 
Participants: The sample (n=20 women) was 
selected from the RCT sample (n=117, 95% women, 
mean age 76 (SD±8) years). Interview participants 
were selected using a purposive sampling list based on 
the RCT outcomes. 

Outcomes: We asked participants about their 
experiences completing the RCT questionnaires. 
Interviews were analysed thematically, then compared 
with the questionnaires. 

Results: Interviewees had difficulties in translating 
complex experiences into a single value on a scale and 
understanding the relationship of the questionnaires to 
study aims. Interviewees considered important for the 
trial that their actual experiences were understood by 
trial organisers. This information was not transferrable 
by means of the questionnaires. To rectify these 
difficulties, interviewees used strategies such as 
adding notes, adding response categories or skipping 
an item. 

Conclusions: Elderly interview participants understood 
the importance of completing questionnaires for trial 
success. This led to strategies of completing the 
questionnaires that resulted in 'missing' or ambiguous 
data. To improve data collection in elderly populations, 
educational materials addressing the differential logics 
should be developed and tested. Pilot testing validated 
instruments using cognitive interviews may be 
particularly important in such populations. Finally, when 
the target of an intervention is a subjective experience, it 
seems important to create a method by which 
participants can convey their personal experiences. 
These could be nested qualitative studies. 
Trial registration number: ISRCTN771 081 01 807. 



Strengths and limitations of this study 



Validated study instruments insufficiently capture 
elderly participants' experiences, qualitative 
methods can facilitate a better understanding of the 
experiences with RCT interventions and outcomes. 
The use of qualitative methods helped to under- 
stand what clinical trial participants understand 
as 'good data'. 

Clinical trial participants knew the importance of 
complete data collection for the success of the 
trial, but they had a different understanding of 
'good data' than the one underlying quantative 
study instruments. 

The study sample had experienced pain for a 
very long time. This may make this group of 
women especially thankful for providing options 
to treat their long-lasting pain and therefore 
more eager to comply with study requirements. 
Thus, these findings may be particular to an 
elderly and female population. 



INTRODUCTION 

There are many factors that are crucial to 
the success of clinical trials, including vali- 
dated study instruments. An adequate assess- 
ment of the study endpoint is a crucial 
aspect of clinical trials; for this, validated 
questionnaires are considered as one of the 
assessment tools for this purpose. The uti- 
lised instruments should be able to measure 
the same constructs consistendy and accur- 
ately across individuals. There are some well- 
known questionnaire completion strategies 
such as marking the midpoint of a scale that 
prevent an accurate assessment of outcomes. 
Much effort has been devoted to the design 
of study instruments to discourage such 
behaviour. 

The gold standard to assess subjective 
study endpoints is valid and reliable instru- 
ments. Validity corresponds to the question 
of how well an instrument measures what it 
intends to measure, such as pain and inten- 
sity. 1 Reliability is established through tests 
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and retests and validity through the comparability of a 
scale with other scales. 2 3 This means that if an instru- 
ment is used repeatedly and achieves the same results 
throughout or gives similar results to an instrument that 
has already been validated then its results are considered 
valid and reliable. For fluctuating, subjective experi- 
ences, such as pain, reliability and validity of scales only 
depicts part of the picture. 4-7 The experience of pain is 
influenced by context, meaning, emotional aspects, 
expectations, attitudes and beliefs associated with pain. 5 
These aspects make it difficult to know what dimensions 
pain scales capture. Indeed, while commonly used one- 
dimensional pain rating scales, such as the reliable visual 
analogue scale (\AS) 8 are considered the gold standard 
for pain assessment, 9 have been validated in various 
populations, including elderly populations, 10-16 and are 

1 7 

more often used in clinical practice and research ; it 
remains unclear what the meaning of the information 
that such one-dimensional pain scales deliver repre- 
sents. 18 19 Thus, diagnosing chronic pain poses pro- 
blems to researchers and clinicians, despite existing 
validated instruments. 20-22 

As the example of one-dimensional pain scales show, 
adequate results for commonly used performance cri- 
teria such as validity and reliability do not necessarily 
suggest that such results suffice to depict complex sub- 
jective experiences. 

In a randomised controlled trial (RCT) that compared 
the effects of Qigong and exercise therapy on neck pain 
in the elderly, no effect on pain intensity could be 
detected. 23 Three groups were compared: a Qigong 
group, an exercise therapy group and a waiting list 
group. No difference between groups was found for the 
primary (\AS) and the secondary endpoints (Neck, Pain 
and Disability Scale based on a common depression, 
health-related quality of life, sleep quality and satisfac- 
tion with the therapies) . However, almost all study parti- 
cipants indicated that they would recommend the 
therapy to others and some even chose to continue the 
interventions at their own expenditure. 23 Thus, we were 
interested to understand how participants transferred 
their observations and experiences into the study meas- 
urement instruments. 

The analysis aimed to understand how women (mean 
78±8 years of age) who participated in an RCT cognised 
the study instruments that were used to evaluate the 
primary and secondary endpoint outcomes of the 
intervention. 

METHODS 
Study design 

We conducted a qualitative study nested within an RCT to 
better understand the RCT results. 23 The trial was con- 
ducted by the Institute for Social Medicine, Epidemiology 
and Health Economics at the Charite Universitatsmedizin 
Berlin. Participants gave written and oral consent to par- 
ticipate in the RCT. The selected participants were invited 



by phone to participate in an interview on their experi- 
ences with the RCT. The interviews took place at the parti- 
cipants' homes and they were asked to provide additional 
oral consent for a home visit. The consent process was 
documented in the case report forms. The RCT included 
117 patients with chronic neck pain who were randomised 
to a Qigong group, an exercise therapy group or to a 
waiting list group. At three different time points, all three 
groups completed four validated questionnaires: the \AS, 
the Neck Pain and Disability Scale (NPDS), 24 the 
Short-Form-36-Questionnaire (SF-36) 25 26 and a common 
depression scale (ADS). 2 The NPDS is a specific evalu- 
ation instrument for neck pain that has been shown to be 
valid and reliable to measure neck pain 28-30 and to detect 
clinically relevant changes in neck pain. 31 It consists of 20 
items that assess intensity of pain using neck problems as 
well as emotional and cognitive influences on work and 
everyday life. 32 The ADS, which is the German version of 
the Center for Epidemiological Studies Depression Scale 
(CES-D), 33 assesses the length and adverse effects of 
depressive symptoms, bodily problems and negative 
thought patterns. This instrument is recommended for 
use with chronic pain patients. 34 These instruments are 
the standard tools for these diagnoses. However, they are 
not satisfactorily validated for the age group under study. 23 
We developed a semistructured interview guide that 
included questions related to the intervention and study 
instruments, more specifically asking about difficulties 
the patients may have had in completing the question- 
naires and what was important for them in their experi- 
ences related to the study interventions. Prior to 
conducting the interviews, the interview guide was 
piloted in mock interviews with older patients with neck 
pain to ensure that the questions functioned well and the 
information was received as intended by the study aims. 

Recruitment 

In order to achieve a diverse selection of interview parti- 
cipants from the quantitative study (QIBANE) for the 
interview study, sampling was based on the results of the 
primary endpoint of the study. We wanted to ensure that 
the interview sample reflected the entire range of 
responses to the primary endpoint, which was decreased 
in neck pain as measured by the VAS. 35 In addition, sec- 
ondary endpoints such as the NPDS 36 and the quality of 
life questionnaire SF-36 37 were considered as secondary 
criteria for sample diversity. Thus, we created different 
groups of QIBANE participants: one group comprised 
QIBANE participants who had indicated an improve- 
ment of symptoms between baseline and follow-up 
assessments, one group who had shown worsening symp- 
toms and the other group comprised those who had no 
change between baseline assessment and 3-month 
follow-up. In each group, a ranking was established that 
started with the individuals with the largest differences 
between both assessment points. Once the rankings 
were established, participants were called until 10 parti- 
cipants from the Qigong group and 10 participants from 
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the exercise therapy group agreed to a qualitative inter- 
view. Interviewee recruiters who called participants had 
previously conducted the RCT and were known to parti- 
cipants. Participants in the RCT were mosdy women 
(95%), which led to a list of potential interview partici- 
pants which comprised predominantly women. 
Recruitment ended after the first 10 RCT participants 
from the Qigong and another 10 from the exercise 
therapy group had agreed to participate. A sample size 
of 20 participants was chosen based on the experiences 
of other qualitative studies that were nested in RCTs. 38 39 

Data collection 

Interviews were conducted in the homes of the partici- 
pants to ensure that participants felt comfortable and 
were willing to speak openly. 40 Interviewers had previ- 
ously organised the RCT and were well known to the 
interviewees. Interviews were conducted at the home of 
the interviewees to accommodate study participants and 
to create a relaxing atmosphere for the interviewee. 40 To 
help their memory, interview participants received blank 
sample questionnaires similar to the ones they had filled 
out during their RCT participation. While an interview 
guide was prepared for the interview, it was used in a 
flexible manner to allow for discussion that was import- 
ant to the interviewees. 41 42 After each interview, the 
interviewer completed a standard protocol developed by 
Miles and Hubermann 4 ' 5 to capture the atmosphere, 
setting and main themes of the interview. Interviews 
were digitally recorded and transcribed. The text docu- 
ments were then entered into software programme 
ATLAS, ti for coding and analysis. 

Data analysis 

As interviewers were not involved in data analysis, the 
interview protocols provided the contextual information 
for the research team to situate the interview, its dynam- 
ics and content. Analysis of the study was multilayered. As 
a first step, the qualitative interview materials were read 
by all researchers and analysed independently by JK and 
JR using content analysis according to Mayring. 41 42 44 
This allowed focusing the analysis on the interview pas- 
sages in which the questionnaires were discussed. The 
coding scheme was developed based on the emerging 
themes from the interview material by two of the authors 



(JK and JR) and then refined by the research team (all 
authors). In addition, coding and results were regularly 
presented and discussed in a qualitative working group. 
The goal of the presentation to the working group was to 
ensure that materials and results were consistent with 
each other and to broaden the perspectives on the mate- 
rials and ensure intersubjectivity of results. After analysis 
of interviews, we compared the quantitative question- 
naires that had been completed by the interviewees in 
the RCT with interview results to identify strategies of how 
study instruments were used. 

RESULTS 

Sample description 

Of those who were called and invited to participate in 
the interview study, six declined a home visit due to fear 
of fraud. A short time prior to the recruitment for the 
interview study there had been some robberies in the 
senior residency and there was heightened awareness 
with regard to possible scam calls. The remaining 20 
people agreed to participate in the interviews. Table 1 
shows the changes the interviewees had indicated on the 
validated scales during the RCT. Eleven of the intervie- 
wees indicated a wish to continue the therapy even 
though they had not experienced an improvement of 
pain according to the validated instruments. 

All interviewees were women with an average age of 
76 years. They had an age range of 67-85 years. On 
average, they had experienced pain for 15 years. All 
interviewees lived in residencies for seniors in Berlin. 

Experiences completing the questionnaires 

Many of the interviewees were dissatisfied either with 
the questionnaires and scales that they had to complete 
or the strategies they used to complete them. They com- 
plained about the difficulties of expressing complex 
experiences in the standardised terms the questionnaire 
asked of them. 

Questionnaires are always terrible because you never can 
express by checking a box what one wants to say. [QG2/ 
241] 

If I make this movement, it hurts here. If I make that 
movement, it hurts there. Now the pain is gone. Now I 



I 



Table 1 Changes in measurements between baseline and primary endpoint of the interviewees 





Improvement 


Worsening 


Missing data 


Questionnaire* 


(number of patients) 


(number of patients) 


(number of patients) 


VAS 


9 


11 


0 


NPDS 


13 


6 




SF-36 


11 


8 


: 


ADS 


5 


8 


7 



*One participant had no change in the NPDS. 

ADS, Common Depression Scale; NPDS, Neck Pain and Disability Scale; SF-36 (mcs=mental component score: mental component summary 
scale of the Short-Form-36-Questionnaire); VAS, visual analogue scale. 
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look at you and I don't experience any pain. Now you 
tell me, do I have pain or do I not have pain? You tell 
me! [QG2/318] 

Some women were also concerned about the type of 
questions that were asked of them; questions related to 
their mental state as asked on the ADS and partially in 
the NPDS were especially disconcerting to some intervie- 
wees. Some interviewees were concerned that study staff 
may not adequately interpret their answers in the ques- 
tionnaires because they were not able to precisely 
express on them how they felt. 

In these questions one often has potential answers that 
partially fit and partially do not fit, so that one would say, 
'yes, that is how it is, but....' (...) and since there is no 
possibility for the opposite, the whole answer isn't right. 
[QG10/011] 

None of the interviewees felt that their experiences 
with pain or with living as an elderly person could be 
adequately described based on responses to the ques- 
tionnaires that were administered to them. Particularly, 
translating complex experiences into a single response 
on a scale was a challenge for the women. Participants 
used different strategies to deal with these problems 
when they completed the scales. These were mainly add- 
itional notes, placing the mark in the middle of a scale, 
adding answer categories or skipping an item. The 
women used these strategies because they felt that the 
scales could not capture their individual experiences. At 
the same time at least some felt indebted to the study 
since it gave them free exercise classes and they wanted 
to attend to the questionnaires in the best possible 
manner. Thus, they added to the questionnaires the 
information they found pertinent. 

Specifying standardised answers 

Adding notes 

Adding notes was a common strategy among the intervie- 
wees. Of the interviewees, 15 added information on an 
item to clarify what the value on the scale they marked 
signified. For example, one participant added to her 
answer for the item, 'frequency of physical activity', the 
time frame, '30 or 60 minutes!' and the circumstances of 
the exercise, 'with partner or by myself [PN7]. The same 
participant added to her answer to the item, 'frequency 
of falls', 'in snow'. She had indicated that she had fallen 
once. Finally, on the NPDS, the patient wanted to specify 
her pain and added "in the lumbar spine and in the 
knees." Another participant added a note to the value 
she selected on the YAS, "I exercise daily. This is the only 
way I can remain relatively painless" [PN6] . 

Others added handwritten notes to the response 
options instead of selecting a response on the scale. For 
example, one participant [QG5] added verbal signifiers 
to the scale on the NPDS such as seldom, satisfied or little. 
In the interviews, this particular participant reported 
about the questionnaires. Another participant [QG6] 



specified one question in the NPDS in the interview. 
Instead of putting a mark next to the question "does the 
pain hinder you with activities such as eating, dressing or 
hygiene?" the participant responded by writing dressing. 

Similarly, where items asked for specific time frames, 
participants sometimes chose to change the time frame 
in order to meaningfully answer the questions. They 
noted on the side the time frame they referred to in the 
answer. For example, for a question that asked for a 
judgement of the past 3 months, one respondent wrote, 
"[t]his has been in the last six months" [QG10]. The 
theme addressed in the question seemed more import- 
ant to the interviewees than the requested time frame. 

Selecting parts of an item 

Another strategy to respond to the questionnaire and 
specify general questions was to underline parts of a 
question to highlight what exactly the answer referred 
to. For example, one participant [PN7] underlined 
'kneeling' in an item of the SF-36 that stated "to bend 
forward, kneeling." Another such example comes from 
an either/or question in the NPDS. Two of the partici- 
pants fPNl] [QG4] marked one of the two given possi- 
bilities in the item, "How difficult is it for you to look up 
or down?" Underlining was also used in questions that 
required a response along a scale. Several of the intervie- 
wees simply underlined one of the top or bottom values 
on the scale instead of marking a point along the scale. 

Being a study participant 

Some of the women had a clear understanding of the 
reciprocal relationship with the staff of the RCT; the 
women received interventions in exchange for complet- 
ing the questionnaires. However, this required that they 
seriously considered their responsibility and wanted to 
complete the questionnaire adequately and accurately. 
Furthermore, the questionnaires used in the study left 
some women feeling uneasy and unhappy with their 
contribution. 

I was actually glad when I was done, just like school work 
that I had to do and I did very thoroughly. But I was not 
satisfied with my work and also not with the questions! 
So, I wasn't- but I have experienced such feelings with 
other questionnaires before. [QG2/265] 

I hope I have filled out everything correctly. I do not 
know if I filled them out correctly. [PN9/163] 

One woman called a family member and her family 
physician to assist her in completing the questionnaire 
in order to ensure the correctness of the questionnaires. 

I don't remember for which question that was. I really 
did not know what to do with that question. I did not 
want to do anything wrong, so I called my daughter. She 
is a teacher and she also really had to think about it. But 
I cannot tell you which question that was at the time. I 
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don't know. But the question was phrased very strange. 
[QG8/207] 

Seriously considering their role as study participant 
was a common theme in the interviews and was the 
main reason why interviewees were dissatisfied with the 
assessment tools used in the RCT. The interviewed 
women assumed that their precise and exact experiences 
were of importance to the clinical trial staff and they 
were very concerned that the staff could not interpret 
their marks correctly on the assessments. The women 
made clear in the qualitative interviews that they pre- 
ferred such an assessment much more than the ques- 
tionnaires because the interviews enabled them to 
correctly state their experiences. 

One just could not answer that question clearly. I don't 
know. I basically followed my feelings — but did you 
understand my answer? What you really get out of my 
answer is the question [...]. So I had the feeling after I 
filled out the questionnaire that you cannot learn any- 
thing from those answers. I guess I would have to say: I 
would not trust those questionnaires. But those are your 
main interest, aren't they?! [QG6/028] 

The questions [in the questionnaire] do not make sense. 
I would have thought it better if you would have, just like 
you are doing now, asked the people directly. [QG4/250] 



DISCUSSION 

The interviewees in this study considered their role as a 
study participant important and perceived it as their 
responsibility to answer the questionnaires as accurately 
as they could to depict their experiences with chronic 
pain. However, they reported that this task was not easy 
for them. They had difficulties making non-specific 
statements about specific experiences and many thought 
that their experiences could not be depicted in the 
questionnaires; many also feared that their answers 
could be misunderstood. Several strategies were used by 
respondents to deal with the problem, such as adding 
notes, marking particular parts of a question or leaving 
an item open. Some also asked others to help them 
complete the questionnaires correctly. Strategies such as 
adding notes have been called 'optimising' strategies. *' 
In addition, leaving an item blank or putting the mark 
in the middle of a scale is called 'satisficing' strategy, sug- 
gesting that questions are answered cursorily. 

Satisficing strategies are more common when study par- 
ticipants do not understand why certain questions are 
asked. 46 This is what the interviewees described especially 
in relation to the ADS. In the rationality of the researchers, 
it was necessary to use the ADS for the RCT because an 
association between depression and chronic pain has been 
found before, and therefore needed to be controlled for 
in the RCT. However, examining the association between 
mental state and pain was one that alienated research par- 
ticipants from the study. They did not consider pain and 



mental state as related to each other. The age group of the 
interviewed women may be one in which depression and 
other psychiatric diseases have a strong stigma associated 
with them. In addition, women in the study population 
may belong to a generation that had learned that one had 
to be strong and go about one's business without any pro- 
blems. Such attitudes may make it difficult to admit psy- 
chological problems as well as difficulties with chronic 
pain more generally. The conflict between the logic of 
quantitative research and that of the study participants was 
obvious throughout the interview results. Medical research 
needs standardised questionnaires of intraindividual and 
interindividual comparisons and a particular kind of 
objectivity. 47 It depends on decontextualising personal 
experience in order to make the experience comparable 
and transferrable independent of time and place. This 
contrasts with the participants' sense of personal experi- 
ence. Participants aimed to describe a precise and specific 
personal experience that aimed at being as accurate as 
possible. Questionnaires are developed to deduce 
complex experiences for statistical analysis. For our inter- 
viewees, this reduction, in fact, meant that it was more diffi- 
cult to answer the questionnaires and some of the 
interviewees felt frustrated by their inability to give an 
exact depiction of their experience through their answers 
to the questionnaires. 

The extra effort interviewees went through to docu- 
ment their particular experiences contradicted the 
researchers' efforts to obtain quantitative data that are 
comparable across time and place. To adequately 
present their experiences, interviewees manipulated the 
questionnaires where they found it necessary for a more 
accurate description of their experiences. In addition to 
adding notes, women in our sample marked different 
points of a scale to describe their experiences. While 
this was an optimising strategy for the women, research- 
ers consider such items as 'missing data' or 'unscorable 
data'. Thus, the effect was the opposite of what the 
women had intended and, in fact, these strategies could 
undermine the validity of study results. The interviewed 
women aimed at optimising their data to give a full 
picture of their experiences and, in some instances, pro- 
duced data that were then not interpretable anymore 
from a statistical point of view, for example, two marks 
on one scale. However, the range of using these strat- 
egies and the amount of missing data in the overall 
study (5% across all measurements and time points) are 
comparable to other RCTs. To minimise such faulty 
data, it is important to know how the elderly population 
may understand the significance of their study participa- 
tion in order to intervene and improve data collection 
in this age group. 

The conflict lies in a classic problem: questionnaires 
by default oversimplify complex experiences. The way 
these are reduced reflect interests of the researchers 
more than the patients. 48 In the process of such reduc- 
tion, research subjects, in fact, become objects that 
produce data that are acceptable to the researchers. 49 
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What are the implications to potentially untangle these 
two different logics that clash in clinical trial participa- 
tion, specifically in completing questionnaires? 

Warms et ar analysed the strategy of adding notes 
more closely and found that questionnaires were seen as 
a means that study participants communicated with 
study researchers. This corresponds to our findings of 
the importance interviewees assigned to trial participa- 
tion. As such they assumed their individual experiences 
were of importance. When the communication tool is 
not perceived as a good one, study participants may 
react with frustration. ' 1 Again, this may have direct con- 
sequences on study results as it may lead to satisficing 
strategies in completing the questionnaires. 52 However, 
these strategies are not a sign that study participants do 
not want to comply with study requirements. On the 
contrary, our study participants developed these strat- 
egies precisely because they knew how important accur- 
ate data are for an RCT to be successful. Thus, 
understanding adding notes as a participant's wish to 
direcdy communicate with the researchers of the study 
and as participants' correct understanding of the 
importance of completing these questionnaires helps 
develop solutions that may not undermine the efforts of 
the research. Nesting qualitative components such as 
interviews into clinical trials may facilitate such commu- 
nications and help to respect participants' perspectives 
and give them voice to communicate with research- 
ers. 53 54 In addition, measurements have been devel- 
oped that assess participants' experiences of study 
participation. 55-57 If the study endpoint consists of a sub- 
jective experience that needs to be assessed in a standar- 
dised manner, it may be necessary to address that 
'accurate' has a particular meaning in research that may 
differ from how study participants consider 'accurate' 
and explain the importance of sticking to provided 
instructions. It may be useful to develop such a standard 
leaflet explaining the need of standardisation. 

In our interview study, only women participated. The 
RCT in which this study was nested had mosdy female 
participants (95%). Thus, the female sample in the 
interview study is a reflection of the RCT population, 
which, in turn, is a reflection of the larger proportion of 
women in this age group overall. Regardless, it is likely 
that men may not have been as eager to adequately 
depict their personal experiences in the questionnaires 
or would not have taken their responsibility as study par- 
ticipant as important as have the interviewees in the 
study. Similarly, since we only interviewed 20 of the 117 
RCT participants, it is conceivable that those who 
agreed to participate in the interview study took their 
role as study participant seriously. However, since we had 
created a ranking list with which we began recruitment 
and only six refused because they feared fraud, it would 
be surprising that we found those that were extraordin- 
arily eager. Their seriousness about study participation 
could be a reflection of the values of a particular gener- 
ation and age group. Finally, this group of women had 



experienced pain for a very long time and was open 
enough to try treatments that they had not tried before, 
which may make this group of women especially thank- 
ful for providing options to treat their long-lasting pain. 
It is, therefore, possible that these findings are particular 
to an elderly population. Considering that there is a 
need for more medical research in elderly populations, 
it seems important to carefully evaluate the types of 
questionnaires used in such populations and to consider 
ways to explain the importance of standardised answers 
for clinical trials research. The need to use cognitive 
interviewing to improve questionnaires has been voiced 
before 58 and the findings of this study underline the 
importance of such pilot testing before instruments are 
used in specific populations. 

While the strategies that were used by the women in 
this study in completing their questionnaires have been 
described in the literature, 45 46 52 no study has yet 
described the relationship between perceptions research 
participants have about their role and the ways they com- 
plete their questionnaires. Overall, participants were fru- 
strated with the questionnaires used, all of which are 
standards for diagnosis that are commonly used in 
research. To improve knowledge production in medi- 
cine, it may be important to address these differential 
understandings of the ways in which clinical trial partici- 
pants are of importance. 

In this study, we showed that a clear discrepancy existed 
between the logic of quantitative research and the logic of 
RCT participants. Interviewees thought it was important 
for the trial that their actual experiences were understood 
by trial organisers. These were not transferrable by means 
of the provided questionnaires, so they added their experi- 
ences by handwritten notes on the questionnaires. 
However, the statistical analysis of RCT data needs this 
reduction of experience in order to produce results. ' 9 
Study participants are a crucial component of clinical 
trials research as they are necessary for data production, 
but these data necessarily are reductionist and aim to gen- 
erate data that are comparable and quantitative in nature. 
Individual experiences need to be reworked to fit such cri- 
teria as comparability and objectivity. Interviewees who 
had participated in QIBANE knew of their importance for 
the trial. Consequently, they seriously considered their task 
of filling out questionnaires and tried to provide the best 
possible information. However, it was exactly this effort 
that, in some cases, led to strategies to convey their per- 
sonal experience as best as possible, that undermined the 
aims of the study to get complete data. To improve data 
collection, increased effort may have to be invested in edu- 
cating about the ways 'experiences' need to be translated 
into comparative, standardised information to be able to 
use them for clinical trials research and what 'accurate' 
filling out of questionnaires means from a research per- 
spective. Similarly, additional venues to the regularly used 
validated instruments that measure subjective and fluctuat- 
ing experiences should be implemented to enable 
research participants to voice their experiences. These 
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could include group discussions or interviews. Integrating 
qualitative and quantitative components such as imple- 
mentation and process evaluation in addition to interviews 
can provide essential information that can improve 
research with this unique and growing population. 
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